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Attorney Docket No. 450137-04958 

IMAGE GENERATING METHOD AND IMAGE GENERATING APPARATUS 

BACKGROUND OF THE INVENTION 
1. Field of the Invention 
5 The present invention relates to an image 

generating technique and, more particularly, to an image 
generating method and image generating apparatus operated 
on the basis of combining a plurality of images. 

10 2. Description of the Related Art 

Techniques for displaying a digitized map image on 
a display apparatus have been known in the form of 
software for PCs or Internet services. Map images are 
generally prepared for a plurality of discrete scales so 

15 that one of the plurality of map images is displayed. at a 
desired point of time. 

When a scale is changed and a map image displayed 
on a display apparatus is changed accordingly, a user may 
lose sight of an object that the user had .paid attention 

20 to or it may take a substantial time for the user to 
understand the currently displayed area. From these 
points of view, when the scale of a map image is changed, 
the displayed map image is desirably switched from one to 
another smoothly. 

25 Smooth switching between displayed images is 

required not only in the case of digitized map images but 
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also in the case of drawing a landscape in applications 
such as games. In games, three-dimensional data of 
objects are prepared in advance. An image is re-rendered 
in accordance with a change in the magnification of image 
5 to be displayed and the position of point of view, so 

that smooth image changing or switching can be realized. 
The volume of calculation required for the re-rendering 
may be significantly increased depending on the degree of 
movement of point of view, the number of objects to be 

10 displayed and the degree of complexity thereof. Further, 
there may arise a problem about the size of capacity of 
memory for storing three-dimensional data of a large 
number of objects. Accordingly, for CG images in general, 
including those used for games, smooth changing between 

15 images requires further technical improvement. 



SUMMARY OF THE INVENTION 
The present invention was developed in light of the 
20 above circumstances and an object thereof is to provide a 
technique for changing a currently displayed image 
smoothly . 

A preferred embodiment according to the present 
invention relates to an image generating apparatus. This 
25 apparatus comprises: a first input unit to which a 

predetermined parameter value related to an image to be 
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displayed is inputted, a second input unit to which a 
plurality of original images with respective parameters 
defined therefor are inputted and an image generating unit 
for performing a predetermined converting process upon the 
5 plurality of original images in order to generate 

intermediate images from the plurality of original images 
such that the parameter values of the plurality of original 
images match each other, for combining the plurality of 
intermediate images thus generated such that their 

10 corresponding areas are made to overlap, and for outputting 
a final combined image. According to this configuration, 
the image generating unit performs a processing such that 
the parameter value of the final image matches the parameter 
value inputted with respect to the image to be displayed. 

15 Examples of the parameter include: 

1. a parameter about the size of image to be displayed 
such as a scale of an image, 

2. a parameter about a space that should be included 
in the image to be displayed such as a position of point 

20 of view of an image, a direction of sight line or an 
angle of view, 

3. .a parameter about the appearance of image to be 
displayed such as the average of colors of pixels 
constituting the image and the amount of high frequency 

25 component included in the image, and 



00167724 



Attorney Docket No. 450137-04958 

4. a parameter about the time for the image to be 
displayed such as the time when the image was shot • 
The parameter may be any attribute that affects the 
contents of image to be displayed. The parameter may 
5 relate to a two-dimensional image or may be referred to 
when the two dimensional image is generated from a three 
dimensional space . 

The image generating unit may increase the weight 
of an intermediate image generated from an original image 

10 with a corresponding degree of approximation^ in terms of 
its parameter, to the image to be displayed. Further, the 
image generating unit may mix a plurality of intermediate 
images so that the resultant image is displayed in an 
intermediate manner with respect to a detail level of 

15 information. In this case, display is possible in which 
an object is gradually made to appear or disappear in 
accordance with a change in the parameter value. 

Another preferred embodiment according to the present 
invention relates to an image generating apparatus. This 

20 apparatus comprises: an input unit receiving an instruction 
about a range of an image to be displayed on the screen and 
an updating unit for updating, moment to moment, the 
displayed contents so that, when the range is successively 
shifted and the size of the range is changed concurrently 

25 with the movement, an on-screen movement speed of an image 
currently displayed on the screen is maintained, ''^The 
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instruction about the range of image" includes not only an 
instruction about the size of the range but also an 
instruction about a shift of the range. Further, a 
combination of instructions may be included. 
5 Still another preferred embodiment according to the 

present invention relates to an image generating method. 
This method comprises: preparing in advance a plurality of 
original images with different detail levels of information 
and performing a processing so that, when a target image is 

10 generated by combining the original images, information 

included in an original image with a higher detail level of 
information is presented in the target image. In combining 
the original images, the plurality of original images may 
be aligned in position in advance. 

15 ''The detail level" may be defined for the 

configuration of object included in an image, the number 
of represented colors in the image, the presence or 
absence of text data attached to the object or the 
contents of the text data. ''Presenting of information in 

20 a target image" is realized by various methods such as by 
displaying 100% of the information, displaying the 
information with relatively lighter shades depending on a 
relative weight in the combination or displaying the 
information with a constant shade or color regardless of 

25 the relative weight in the combination. 
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Still another preferred embodiment according to the 
present invention relates to an image generating method- 
This method comprises: performing a rendering processing 
such that, when an object is moved in a virtual space, an 
5 apparent on-screen speed at which the object is moved is 

maintained without being affected by a change in a manner of 
display of the object such as a change in scale. 

It is to be noted that any arbitrary combination of 
the above-described structural components and expressions 
10 changed between a method, an apparatus, a system, a 

recording medium, a computer program and so forth are all 
effective as and encompassed by the present embodiments. 

Moreover, this summary of the invention does not 
necessarily describe all necessary features so that the 
15 invention may also be sub-combination of these described 
features . 



BRIEF DESCRIPTION OF THE DRAWINGS 
20 Fig. 1 is a diagram illustrating an aspect of a 

program processing apparatus according to a first embodiment. 

Fig. 2 is a diagram illustrating another aspect of the 
program processing apparatus according to the first 
embodiment . 

25 Fig. 3 shows a structure of an image generating 

apparatus according to the first embodiment. 
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Figs. 4A through 4E show generation of a target image 
according to the apparatus illustrated in Fig, 1. 

Fig. 5 shows a structure of a file listing information 
of an original image stored in a first storage unit 
5 according to the apparatus illustrated in Fig. 1. 

Fig. 6 is a flowchart of processing for generating a 
target image according to the apparatus illustrated in Fig. 
1. 

Figs. 7A through 7E show generation of a target image 
10 according to the apparatus illustrated in Fig, 1. 

Fig, 8 shows a structure of an image generating 
apparatus according to a second embodiment. 

Figs, 9A and 9B are diagrams respectively illustrating 
structures of files listing information of original images 
15 according to the apparatus illustrated in Fig. 8. 

Fig. 10 is a sequence diagram of processing for 
obtaining an original image according to the apparatus 
illustrated in Fig, 8. 

Fig. 11 is a flowchart of processing for generating a 
20 target image according to the apparatus illustrated in Fig. 
8. 

Fig. 12 shows a structure of an image generating 
apparatus according to a third embodiment. 

Fig. 13 shows a structure of an image generating 
25 apparatus according to a fourth embodiment. 
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Fig. 14 is a flowchart of processing for generating a 
target image according to the apparatus illustrated in Fig. 
13. 

Figs. 15A through 15H show generation of a target 
image according to the apparatus illustrated in Fig. 13. 

Fig. 16 shows a structure of an image generating 
apparatus according to a fifth embodiment. 

Figs. 17A through 17C show a relationship between the 
size of range of target image and an apparent movement speed 
according to the apparatus illustrated in Fig. 16. 

Fig. 18 is a flowchart of processing for generating an 
image to be displayed according to the apparatus illustrated 
in Fig. 16. 

Fig. 19 shows a structure of an image generating 
apparatus according to a sixth embodiment. 

Fig. 20 shows a structure of data for changing the 
size of range of target image according to the apparatus 
illustrated in Fig. 19. 

Fig. 21 shows a movement distance and the range of 
target image according to the apparatus illustrated in Fig. 
19. 

Fig. 22 is a flowchart of processing for generating a 
target image according to the apparatus illustrated in Fig. 
19. 
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DETAILED DESCRIPTION OF THE INVENTION 
The invention will now be described based on the 
following embodiments which do not intend to limit the scope 
of the present invention but exemplify the invention. All 
5 of the features and the combinations thereof described in 
the embodiments are not necessarily essential to the 
invention. 
(First Embodiment) 

In this embodiment, when a map image displayed on a 

10 display apparatus is moved by instructions from a user such 
as those for moving or scrolling the background of object 
manipulated by the user, an image generating apparatus of 
this embodiment generates a map image that has a scale 
changed in accordance with a moving speed (hereinafter, a 

15 scale determined by a user's operation will be referred to 
as ^^a designated scale" and a map image displayed with the 
designated scale will be referred to as ^'a target image") . 
In this embodiment, a description is given of generation of 
a target image in particular. Although the designated scale 

20 may be of any value, the variety of images prepared in 

advance as map images (which hereinafter will be referred to 
as ^^original images") is generally limited to those 
corresponding to discrete scales such as 1/1000 and 1/5000. 
For example, when the designated scale of the target image 

25 is 1/2000, neither of the aforementioned original images 
serves the purpose of displaying the target image. Thus, 

9 00167724 



Attorney Docket No. 450137-04958 

the image generating apparatus of this embodiment is 
provided with the following functions in respect of 
generation of a target image. 

1. A target image with an arbitrary designated scale is 
5 generated from a plurality of limited original images while 
taking an image quality and an information display function 
into consideration . 

2- Even if the scale of a target image once displayed is 
changed, a new target image is smoothly generated and then 

10 displayed. 

The number of original images is limited, however it 
is ensured that a plurality of them remains available. 
Accordingly, in order to generate a target image, 
appropriate original images must be selected. An original 

15 image having a scale which approximates the scale of target 
image and is larger than the same and an original image 
having a scale which is smaller than the scale of target 
image are selected herein. These two original images 
constitute ^^an optimal original image pair". This term 

20 indicates the respective original images included in the 

pair. Scales of images of the optimal original image pair 
are first made to coincide with a designated scale. Then, 
the images are combined. As a result of combining, a target 
image is obtained. 

25 When images are combined, a point or area which is 

common to an optimal original image pair such as the same 
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building is made to overlap and the original image with a 
higher degree of approximation to the designated scale is 
assigned a larger weight. Because of this weighting, when a 
target, image makes a transition from an original image with 
5 a relatively smaller scale to an original image with a 

larger scale due to a change in the designated scale, the 
building shown only in the image with the larger scale is 
made to appear gradually. 

In this way, a target image is generated. Thereafter, 

10 if the designated scale or a place of interest to a user is 
changed, a target image is re-generated from an optimal 
original image pair and then displayed. As a result, even 
if original images are provided discretely, smooth image 
switching is realized. 

15 An '^image" generally indicates the contents displayed 

on a display apparatus. In this embodiment, the term may 
inclusively indicate, in addition to an image which is 
displayed as a map, a significantly large area of an entire 
image potentially displayed as a map. In the case that the 

20 term ^^image" indicates the entire image, this image is not 
displayed as it is. Parameters such as a portion of the 
image that should be actually displayed and a scale should 
be determined before the image is displayed on the display 
apparatus. Whether the term ^^image" is used to mean an 

25 image displayed or an image in the latter meaning will not 
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be clearly mentioned hereinafter unless discrimination is 
required. 

In order to perform a converting processing to be 
described later on an image, an orthogonal coordinate system 
5 is defined. This coordinate system may include, e.g., 
latitude and longitude, and is uniquely defined for an 
actual land, which is an object to be displayed in the form 
of a map. When a map is drawn by partitioning the land, 
coordinates determined by the absolute coordinate system are 

10 defined. For example, it is assumed that Tokyo Station is 
at the origin of coordinate (0, 0) and Shinjuku Station is 
represented as (a, b) . In any image utilized in this 
embodiment including Tokyo Station, the coordinate of that 
point within the image, i.e., Tokyo Station, is always (0, 

15 0) . Similarly, the coordinate of a point in an image 

including Shinjuku Station is always (a, b) . Thus, the 
coordinate defined in an image is determined regardless of a 
scale - 

A scale is determined by a ratio of a distance between 
20 two points displayed on a display apparatus with respect to 
a distance between the two points on an actual land. For 
example, when the actual distance between ^^Tokyo Station" 
and ^^Shinjuku Station" is 10 km and the distance between 
them when displayed on a display apparatus is 10 cm, the 
25 scale of a displayed image is determined as 1/100000. 

According to this embodiment, unlike paper maps, the scale 
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depends on display apparatus. For simplicity of description, 
the scale will be calculated hereinafter assuming that an 
image is displayed in a square area of 10 cm x lo cm 
regardless of display apparatus. The square area will 
5 hereinafter be referred to as ^'a display window". When the 
size or configuration of an area where an image is displayed 
is actually different from one display unit to another, a 
state in which a known linear conversion is performed upon 
the display window may be considered- Such a state will not 

10 be described in detail. 

In a display apparatus, a display window is defined by 
arranging a plurality of pixels. The arrangement of pixels 
inherently depends on display apparatus. For simplicity of 
description, the number of pixels 400 x 400 is assumed in 

15 this embodiment . 

An image which is actually displayed on a display 
window, i.e., a target image is determined by designation of 
a range in an original image as well as by a scale. Thus, a 
designation from a user is awaited. The range determined by 

20 the user's designation will be referred to as ^'the range of 
target image". 

In accordance with this embodiment, images 
constituting an optimal original image pair are subject to 
scale conversion so that two intermediate images with 

25 respective scales matching a designated scale are generated. 
These intermediate images have the same scale. Nevertheless, 

13 00167724 



Attorney Docket No. 450137-04958 

the finer the detail level of an original image, the finer 
the detail level of the intermediate image generated from 
the original image. An intermediate image with a finer 
detail will be referred to as ^'a detailed image" and the 
other image will be referred to as ^^a simple image" 
hereinafter, in spite of the identical scale. 

Figs. 1 and 2 illustrate different aspects of a 
program processing apparatus 106 according to the first 
embodiment. According to both aspects, the unit comprises 
an operating unit 104, a processor 102, an image generating 
apparatus 100 and a monitor 110. The operating unit 104 is 
an interface such as a button for a user to input 
predetermined operation instructions. The predetermined 
operation instructions include instructions about direction 
and speed that the range of target image is shifted. For 
example, the instructions may shift the range of target 
image in the east direction with a higher movement speed 
than a current movement speed. 

The processor 102 carries out a program for displaying 
a map, in order to determine the coordinate placed at the 
center of the display window, from an instruction about the 
movement of the range of target image. The image generating 
apparatus 100 determines the range of a new target image and 
a designated scale on the basis of the instruction about 
movement of the range of target image and the coordinate 
outputted from the processor 102, so as to generate a target 
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image. The target image is displayed on a display window in 
the monitor 110, 

Referring to the example in Fig. 1, an original image 
is stored in a first storage unit 20 in the program 
5 processing apparatus 106. In accordance with the example in 
Fig. 2, unlike Fig. 1, an original image is also stored in 
an external storage unit 116 in a server 114 placed outside 
the program processing apparatus 106. In the example shown 
in Fig. 2, the image generating apparatus 100 accesses via a 

10 network 112 the external storage unit 116 when an original 
image is required. The image generating apparatus 100 
illustrated in Fig. 1 generally accesses an original image 
at higher speed than the image generating apparatus 100 
illustrated in Fig. 2. Nevertheless, the image generating 

15 apparatus 100 illustrated in Fig. 2 can make an area for 
storage of original images in the program processing 
apparatus 106 smaller than that of the image generating 
apparatus 100 illustrated in Fig. 1. 

Fig. 3 shows a structure of the image generating 

20 apparatus 100 illustrated in Fig. 1. The image generating 

apparatus 100 has an input unit 10, an image setting unit 12, 
an image obtaining unit 14, an image generating unit 16, an 
output unit 38 and an information obtaining unit 18. 
Further, the image setting unit 12 includes a display area 

25 calculating unit 24 and an update operation determining unit 
26. The image obtaining unit 14 includes an obtaining 

15 00167724 



Attorney Docket No. 450137-04958 

identifying unit 28 and an obtaining processing unit 30. 
The image generating unit 16 includes a converting unit 32, 
a corresponding point matching unit 34 and a combining unit 
36. 

5 These components can be implemented by hardware such 

as CPUs for any computers, memories and other LSIs, or 
software such as programs loaded in memories. Functional 
blocks implemented by cooperation of such elements are 
illustrated herein. Accordingly, a person skilled in the 

10 art would understand that these functional blocks are 
realized in a variety of manners such as by hardware, 
software or a combination of them. 

The first storage unit 20 is a storage area for 
storing original images and is implemented by a hard disk. 

15 A second storage unit 22 is a main memory and implemented by 
a RAM (Random Access Memory) with a higher access speed than 
that of the first storage unit 20. 

Inputted to the input unit 10 is an operation 
instruction from a user. 

20 The display area calculating unit 24 determines, on 

the basis of the operation instruction inputted to the input 
unit 10. by the user, a designated scale and the range of 
target image. 

The obtaining identifying unit 28 identifies an 

25 optimal original image pair from the original images stored 
in the first storage unit 20 on the basis of the designated 
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scale and the coordinate. The obtaining processing unit 30 
has an access to the first storage unit 20 in order to store 
the optimal original image pair in the second storage unit 
22 and prepare for subsequent processing. 
5 The converting unit 32 performs a converting 

processing for changing scales of respective images of the 
optimal original image pair to the designated scale, so that 
intermediate images are generated. In this case, it is 
assumed that one of the images constituting the optimal 

10 original image pair is enlarged and the other is reduced. 

The corresponding point matching unit 34 ensures that 
the corresponding areas of the intermediate images coincide. 
For example, when the coordinate of area showing the same 
building is different from image to image constituting the 

15 optimal original image pair, area-to-area correction 

including shift, enlargement and reduction is performed so 
that the corresponding areas overlap. 

The combining unit 36 combines the intermediate images 
subjected to correspondence in the corresponding point 

20 matching unit 34 using a predetermined ratio so as to 
generate a target image with the designated scale. The 
predetermined ratio is determined so that the original image, 
in the optimal original image pair, with a scale 
approximating the designated scale is larger. This can be 

25 carried out by a blending. The combining is performed based 
on, e.g., the following expression: 
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wherein A indicates data for determining a color at a 
predetermined position in the intermediate image obtained by 
conversion from the original image, in the optimal original 
5 image pair, with a larger scale. B indicates data for 
determining a color at a predetermined position in the 
intermediate image obtained by conversion from the original 
image, in the optimal original image pair, with a smaller 
scale. It is assumed that the position of A coincides with 
10 the position of B. M indicates a ratio of scales between 
images included in the optimal original image pair. X 
indicates a ratio of the scale of the original image 
including A with respect to the scale of the intermediate 
image . 

15 The output unit 38 identifies the correspondence 

between a position, in the coordinate system, in the range 
of target image and the position of a pixel on the monitor 
110 so as to expand the color of the predetermined position 
in the coordinate system to a pixel value at the 

20 corresponding pixel position. 

The information obtaining unit 18 feeds information of 
the optimal original image pair stored in the second storage 
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unit 22 back to the update operation determining unit 26. 
When the designated scale is updated in the display area 
calculating unit 24, the update operation determining unit 
2 6 determines whether the optimal original image pair stored 
5 in the second storage unit 22 can be used to generate a new 
target image • 

Figs. 4A through 4E show original images, intermediate 
images and a target image when the image generating unit 16 
generates the target image from an optimal original image 

10 pair. These images are displayed on the same display window. 
Figs. 4A and 4B will be described first. Figs. 4A and 4B 
show the correspondence between coordinates when original 
images with different scales are displayed on the same 
display window. The range covered by the coordinates of the 

15 image illustrated in Fig. 4A is 16 times as large as that of 
the image illustrated in Fig. 4B. Since Figs. 4A and 43 are 
defined by an absolute coordinate system in spite of the 
different scales, the same object indicated by arrow has the 
same coordinate (100, 100) . The detail level of Fig. 43 is 

20 higher than that of Fig. 4A. Different detail levels are 

assigned in accordance with the scales of prepared original 
images. Specifically, an original image with a larger scale 
has a higher detail level. 

Fig. 5 shows a file indicating information of original 

25 images stored in the first storage unit 20. The file lists 
the address in the first storage unit 20 indicating the 
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location of an original image prepared for a corresponding 
one of a plurality of scales. A data start point and a data 
end point are respectively upper left and lower right 
coordinates in the range of coordinates included in the 
5 original image. When gaining access to the first storage 
unit 20, the image identifying unit 28 and the obtaining 
processing unit 30 first refer to this file and perform the 
respective processing. 

Fig. 6 shows a procedure for generating a target image 

10 by the image generating apparatus 100. The display area 
calculating unit 24 illustrated in Fig. 3 determines the 
range of a target image based on an operation instruction 
inputted to the input unit 10 by a user (SIO) . In the case 
that target images have been already generated, the update 

15 operation determining unit 2 6 obtains, from the information 
obtaining unit 18, information of an optimal original image 
pair already obtained (S12) . If a new optimal original 
image pair is required in order to generate a new target 
image (Y in S14), the obtaining identifying unit 28 

20 identifies an optimal original image pair (S16) and the 

obtaining processing unit 30 stores the identified optimal 
original image pair from the first storage unit 20 in the 
second storage unit (S18) . If a new optimal original image 
pair is not required (N in S14), the optimal original image 

25 pair already obtained is used. 
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The converting unit 32 performs clipping upon images 
of the optimal original image pair at the same coordinates 
as the range of target image (S20) . Further, conversion is 
performed for enlarging and reducing the images of the 
5 optimal original image pair so that their scales match the 
designated scale (522) . As a result, intermediate images 
are generated. The corresponding point matching unit 34 
corrects the intermediate images so that the corresponding 
areas of the intermediate images coincide, i.e., overlap 

10 (S24) . The combining unit 36 combines the intermediate 
images using a predetermined ratio to generate a target 
image (S26) . The generated target image is outputted from 
the output unit 38 (S30) and displayed on a display window 
on the monitor 110. 

15 Returning to Figs. 4A through 4E, Figs. 4A and 4B show 

the optimal original image pair as described above. When an 
instruction is given to reduce the coordinate range of the 
image illustrated in Fig. 4A by 1/4, the converting unit 32 
illustrated in Fig. 3 generates the intermediate image 

20 illustrated in Fig. 4C reduced by 1/4 from the coordinate 
range of the image illustrated in Fig. 4A and the 
intermediate image illustrated in Fig. 4D enlarged by 4 from 
the coordinate range of the image illustrated in Fig. 4B. 
When a user gives an instruction that a designated 

25 scale be gradually changed from a scale approximating the 

scale of the original image shown in Fig, 4A toward a scale 
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approximating the scale of the original image shown in Fig. 
4B, the target image is made to transit smoothly from the 
image of Fig. 4A, through the image of Fig. 4E, and finally 
to the image of Fig. 4B. Further, buildings that are not 
5 illustrated in Fig. 4A are illustrated with relatively 

lighter shades in Fig. 4E and illustrated clearly in Fig. 4B. 
By changing the range of target image, the target image is 
smoothly changed and buildings are made to appear or 
disappear gradually in accordance with the size of range of 

10 the target image. Thus, a user does not lose sight of 

points of interest to the user before and after the change. 

Referring to Fig. 4E, configurations of buildings 
included only in the image of Fig. 4B with a higher detail 
level are displayed with relatively lighter shades. Objects 

15 other than the configurations of the buildings may be 
similarly displayed. When a text ^'Tokyo Station" is 
displayed only on the original image illustrated in Fig. 4B 
of the optimal original image pair, the text ^^Tokyo Station" 
is displayed with relatively lighter shades in Fig. 4E 

20 generated from Figs. 4A and 4B. Changing the range of 

target image from Fig. 4A to Fig. 4B enables the text ^^Tokyo 
Station" which is not originally displayed to be displayed 
so as to become gradually clearer. 

Figs. 7A through 7E illustrate original images, 

25 intermediate images and a target image when the image 
generating unit 16 generates the target image from an 
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optimal original image pair by a procedure different from 
that of Figs. 4A through 4E. As in Figs. 4A through 4E, 
these images are displayed on the same display window. In 
the procedure for generating a target image illustrated in 
5 Fig. 7A through 7E, a converting processing is performed two 
times, i.e., before and after a combining processing, unlike 
the procedure for generating a target image illustrated in 
Fig. 4A through 4E. Images of Figs. 7A and 7B constitute 
the optimal original image pair. The converting unit 32 

10 reduces by 1/16 the coordinate range of the image 

illustrated in Fig. 7A in order to form the image Fig. 7C 
with the same coordinate range as that of the image 
illustrated in Fig. 7B. The combining unit 36 weights the 
images illustrated in Figs.7B and 7C by 1/2 respectively and 

15 combines the images, so as to generate the image illustrated 
in Fig. 7D. Further, the combining unit 3 6, in an added 
processing not found in the case of Figs. 4A through 4E, 
enlarges the coordinate range of the image illustrated in 
Fig. 7D four times in order to generate the image 

20 illustrated in Fig. 7E. 

The operation of the image generating apparatus 100 
with the above-described structure is as follows. For 
example, when a user of a map image application gives an 
instruction on the movement in the map of Chiyoda Ward and 

25 decreases the movement speed near Tokyo Station, the input 
unit 10 specifies a designated scale which is changed in 
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accordance with a change in the movement speed. The 
obtaining identifying unit 28 identifies an optimal original 
image pair including original images respectively 
illustrating Chiyoda Ward and the neighborhood of Tokyo 
5 Station from the first storage unit 20. The obtaining 

processing unit 30 stores the optimal original image pair 
from the first storage unit 20 in the second storage unit 22. 
The converting unit 32 converts scales of images of the 
optimal original image pair into the designated scale in 

10 order to generate intermediate images. The corresponding 
point matching unit 34 overlaps the corresponding areas of 
the intermediate images at the same position. The combining 
unit 36 combines the intermediate images using a 
predetermined ratio. When the designated scale for 

15 generating the target image is further increased, the map of 
the neighborhood of Tokyo Station is finally displayed. 

In accordance with this embodiment, a change in a 
speed for shifting a target image already displayed enables 
a correspondingly smooth change in the target image even 

20 when the scale is changed. Further, a target image with a 

detail level different from that of an original image can be 
generated. Moreover, the scales of original image prepared 
in advance may be discrete so that reduction in data 
capacity is realized. 

25 (Second Embodiment) 
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In accordance with this embodiment, an image 
generating apparatus generates a target image from an 
optimal original image pair by combination described in the 
first embodiment. According to the second embodiment, an 
5 original image in the optimal original image pair having a 
larger amount of data and a higher detail level is generally 
stored in an external storage unit. Thus, a storage 
capacity in a local storage unit that the image generating 
apparatus has can be reduced. The access time to the 

10 external storage unit is considered so that, when an input 
is provided by a user, the image generating apparatus first 
subjects to conversion only the scale of original image with 
a lower detail level in the local storage unit provided in 
the image generating apparatus and displays the resultant 

15 image on a display window. Then, a display on the display 
window is re-rendered. As a result, a target image 
generated by combining the original image with a lower 
detail level and the original image with a higher detail 
level is displayed on the display window. 

20 Fig. 8 shows the structure of an image generating 

apparatus 100 which is of the same type as that of Fig. 2 
and utilized in this embodiment. The image generating 
apparatus 100 has the input unit 10, the image setting unit 
12, the image obtaining unit 14, the image generating unit 

25 16, the output unit 38 and the information obtaining unit 18. 
The image obtaining unit 14 includes the obtaining 
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identifying unit 28, the obtaining processing unit 30 and a 
communication unit 108. The image generating apparatus 100 
is connected via the network 112 to the server 114. The 
server 114 has the communication unit 118 and the external 
5 storage unit 116. This image generating apparatus is 
operated in the same manner as the image generating 
apparatus 100 illustrated in Fig. 3 except for the image 
obtaining unit 14. 

The external storage unit 116 is a storage area in the 

10 server 114 and has larger storage capacity than the first 
storage unit 20. 

The obtaining identifying unit 28 identifies an 
optimal original image pair from original images stored in 
the first storage unit 20 and the external storage unit 116. 

15 In order to access the external storage unit 116, the 
communication units 108 and 118 are used. 

The obtaining processing unit 30 gains access to the 
first storage unit 20 and the external storage unit 116 to 
obtain an optimal original image pair. The obtaining 

20 processing unit 30 may gain access to the first storage unit 
20 and the external storage unit 116 at the same time or may 
perform sequential access, i.e., gain access first to the 
first storage unit 20 and then to the external storage unit 
116. 

25 Fig. 9A shows a file which indicates information of 

original images stored in the first storage unit 20. Fig. 
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9B shows a file which indicates information of original 
images stored in the external storage unit 116. Although 
Figs. 9A and 9B have the same data structure as the file 
illustrated in Fig. 5, an original image with a smaller 
5 scale is stored in Fig. 9A and an original image with a 
larger scale is stored in Fig. 9B, in accordance with 
capacity of storage areas of the first storage unit 20 and 
the external storage unit 116. 

Fig. 10 shows a procedure for obtaining an original 

10 image by the obtaining identifying unit 28, the obtaining 
processing unit 30 and the server 114. The obtaining 
identifying unit 28 notifies the server 114 of information 
such as the range of target image (S80) . The server 114 
searches for a required original image on the basis of the 

15 file illustrated in Fig. 9B (S82) , and sends the result to 

the obtaining identifying unit 28 as image information (384) . 
The obtaining identifying unit 28 identifies one or both of 
images of optimal original image pair from this image 
information and notifies the obtaining processing unit 30 of 

20 the result (S86) . The obtaining processing unit 30 requests 
the optimal original image pair from the server 114 (S88) . 
The server 114 retrieves an original image on the basis of 
its address illustrated in Fig. 9B from the external storage 
unit 116 (S90), performs clipping upon the original image in 

25 the range of target image and sends the result to the 
obtaining processing unit 30 (S92) . 
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Fig. 11 shows a procedure for progressively displaying 
a target image by the image generating apparatus 100. The 
display area calculating unit 24 determines the range of a 
target image on the basis of the contents inputted in the 
5 input unit 10 (SlOO) . If any target image has been 

generated before, the update operation determining unit 26 
obtains information of optimal original image pair already 
obtained, from the information obtaining unit 18 (S102) . 

If a new optimal original image pair is required in 

10 order to generate a new target image (Y in S104), the 

obtaining identifying unit 28 identifies an optimal original 
image pair (S106) and the obtaining processing unit 30 
stores one of the identified original images from the first 
storage unit 20 in the second storage unit 22 (S108) . This 

15 original image is referred to as a first obtained image. 
The converting unit 32 converts the scale of the first 
obtained image into a designated scale (SllO) to generate a 
first intermediate image. The first intermediate image in 
the range to be displayed is outputted from the output unit 

20 38 (S112) and displayed on a display window for the monitor 
110. The obtaining processing unit 30 obtains the other 
original image identified by the obtaining identifying unit 
28 from the external storage unit 116 (S114) . The original 
image thus obtained is referred to as a second obtained 

25 image. The converting unit 32 converts the scale of the 
second obtained image into the designated scale (S116) to 
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generate a second intermediate image. If the corresponding 
areas of the first and second intermediate images are 
displaced from each other, the corresponding point matching 
unit 34 makes the areas coincide (S120) . The combining unit 
5 36 combines the first intermediate image with the second 
intermediate image using a predetermined ratio (S122) to 
generate the target image. The output unit 38 outputs the 
target image again (S124) and updates the display on the 
display window for the monitor 110. On the other hand, if 

10 the new optimal original image pair is not required (N in 

S104), the scale of the optimal original image pair already 
obtained is converted into the designated scale (S118) and 
the above-described processing is carried out. 

In accordance with this embodiment, the storage 

15 capacity of the local storage unit provided in the image 

generating apparatus 100 is reduced. When an instruction is 
given by a user, the scale of original image with a lower 
degree of detail of information locally stored in the local 
storage unit provided in the image generating apparatus 100 

20 is subject to conversion so that the resultant image is 

displayed. Thus, when it takes a time to gain access to an 
external storage unit, initial display is rapidly performed. 
(Third Embodiment) 

In accordance with this embodiment, an image 

25 generating apparatus obtains, if desired, an original image 
with a higher level of detail from an external storage unit 
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as in the second embodiment. In this embodiment, an 
original image is not prepared in advance in the external 
storage unit. Instead, three dimensional data are stored in 
the external storage unit. An original image is generated, 
5 if desired, on the basis of the three dimensional data by a 
rendering processing. 

Fig. 12 shows the structure of an image generating 
apparatus 100 which is of the same type as that of Fig. 2 
and utilized in this embodiment. The image generating 

10 apparatus 100 has the input unit 10, the image setting unit 
12, the image obtaining unit 14, the image generating unit 
16, the output unit 38 and the information obtaining unit 18. 
The image obtaining unit 14 includes the obtaining 
identifying unit 28, the obtaining processing unit 30, an 

15 image information identifying unit 42 and the communication 
unit 108. The image generating apparatus 100 is connected 
via the network 112 to the server 114. The server 114 
includes the communication unit 118, the external storage 
unit 116 and an image calculating unit 44, This image 

20 generating apparatus is different from the image generating 
apparatus lOO illustrated in Fig. 3 in the image obtaining 
unit 14. 

The obtaining identifying unit 28 identifies an 
optimal original image pair from original images stored in 
25 the first storage unit 20 in order to generate a target 

image with a designated scale. Only original images with a 
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lower detail level of information are stored in the first 
storage unit 20. If at least one of original images 
included in the optimal original image pair is not found in 
the first storage unit 20, the original image must be 
5 generated by a rendering processing. In this case, the 
obtaining identifying unit 28 instructs the image 
information identifying unit 42 to generate the original 
image . 

The image information identifying unit 42 identifies 

10 parameters, such as a position of view point and a direction 
of sight line, required for generating the original image by 
the rendering processing in the sever 114. 

The image calculating unit 4 4 performs the rendering 
processing on the basis of the three dimensional data in the 

15 external storage unit 116 to generate the original image 
identified by the obtaining identifying unit 28. By the 
obtaining processing unit 30 gaining access to the first 
storage unit 20 and the server 114, the original image is 
stored in the second storage unit 22. 

20 According to this embodiment, an original image with a 

higher detail level of information is externally generated 
by the rendering processing. Thus, the processing volume in 
the image generating apparatus is not increased and the 
storage capacity of the local storage unit provided in the 

25 image generating apparatus is reduced. 
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Only the three dimensional data may be obtained from 
the server 114 and the rendering processing may be performed 
in the image generating apparatus 100 to generate an 
original image. 
5 (Fourth Embodiment) 

This embodiment is a variation of the first embodiment 
in that generation of a target image in the first embodiment 
is modified and a landscape image in a direction of sight 
line designated by a user of a game (which is also referred 

10 to as ^'a designated direction'') is displayed on a display 
unit (the landscape image displayed in the designated 
direction is referred to as "'a target image" hereinafter in 
this embodiment) . The designated direction may be set as 
desired. Nevertheless, instead of performing a rendering 

15 processing every time a designation is provided, the variety 
of landscape images generated based on three dimensional 
data by the rendering processing (which hereinafter will be 
referred to as ^^an original image" in this embodiment) is 
limited to those of directions indicated by discrete angles 

20 such as 10**, 20° and 30°, in order to reduce the amount of 
calculation in the rendering processing. For example, when 
the designated direction is 45°, the aforementioned original 
image does not meet the purpose of displaying at this angle. 
An image generating apparatus according to this embodiment 

25 generates a plurality of original images of directions 

indicated by discrete angles with respect to an arbitrary 

32 00167724 



Attorney Docket No. 450137-04958 

designated direction, converts directions of sight line used 
to generate the original images into the designated 
direction and then combines the resultant images in order to 
generate a target image. Even when the designated direction 
5 is successively changed, the target image is changed 

smoothly. Although rendering requires information such as 
an angle of view as well as a direction of sight line, the 
angle of view is set to be fixed for convenience of 
explanation. 

10 Although restricted in number, there are a plurality 

of directions of sight line for the rendering processing. 
Among such directions, a direction of sight line suitable 
for generating a target image must be selected. Two 
directions that approximate the designated direction and 

15 sandwich the same are selected herein. These two directions 
will constitute ^^an optimal direction pair'', and two 
original images generated by the rendering processing for 
the optimal direction pair will constitute ^^an optimal 
original image pair''. These terms indicate respectively the 

20 directions and original images included in the pairs. 

Images are shifted so that the direction of the optimal 
original image pair coincides with the designated direction 
before the images are combined. As the result of combining, 
a target image is obtained. 

25 When combining the images, a point or area which is 

common to an optimal original image pair such as the same 
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building is made to overlap and an original image in a 
direction with a higher degree of approximation to the 
designated direction is assigned a larger weight. Since a 
target image is generated as described above, even if the 
5 designated direction is successively changed, smooth 

switching between images is realized without performing a 
rendering processing every time the designated direction is 
changed. 

Fig. 13 shows the structure of an image generating 

10 apparatus 100 which is of the same type as that of Fig. 1 
and utilized in this embodiment. The image generating 
apparatus 100 has the input unit 10, the image setting unit 
12, the image obtaining unit 14, the image generating unit 
16, the output unit 38 and the information obtaining unit 18. 

15 The image obtaining unit 14 includes the image information 
identifying unit 42 and the image calculating unit 44. This 
image generating apparatus 100 is different from the image 
generating apparatus illustrated in Fig. 3 in the image 
obtaining unit 14 . 

20 Although the first storage unit 20 is a storage area 

which is. the same as the first storage unit 20 illustrated 
in Fig. 1, it stores three dimensional data. The three 
dimensional data includes data about an object configuration. 
Inputted to the input unit 10 is a designated 

25 direction by a user's operation instruction. The designated 
direction is indicated by angles 0 and cp. When a point of 
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view is placed at the origin of a world coordinate and the 
designated direction is indicated by a vector from the 
origin (which hereinafter will be referred to as ^^a sight 
line vector") , the angle 9 is an angle formed by the sight 
5 line vector and the z axis of an orthogonal coordinate. The 
angle 9 is an angle formed by a vector in the designated 
direction projected on the x-y plane in the world coordinate 
system and the x axis. For simplicity of explanation, it is 
assumed that the angle 0 is fixed to 90"* and only the angle 

10 (p is variable hereinafter. In other words ^ we assxime that a 
line of view is horizontal. This assxjmption is introduced 
for the direction of sight line as well as for the 
designated direction . 

The image information identifying unit 42 identifies 

15 an optimal direction pair for generating a target image from 
a set of predetermined discrete angle values of direction of 
sight line. 

The image calculating unit 4 4 performs a rendering 
processing upon the three dimensional data in the first 

20 storage unit 20 with respect to the optimal direction pair 
to generate an optimal original image pair. Further, the 
absolute distance between the position of a predetermined 
object displayed on an original image and the position of 
point of view in the world coordinate system is calculated 

25 in order to use in the converting unit 32 to be described 
later. The absolute distance between the position of the 
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predetermined object and the position of point of view 
serves as a turning radius when shifting the image and thus 
will be also referred to as ^^a turning radius". 

The converting unit 32 horizontally moves the 
5 respective images of the optimal original image pair by a 
distance obtained by multiplying the angle formed by the 
direction of sight line and the designated direction by a 
turning radius, in order to match the direction of sight 
line of the original images with the designated direction, 

10 As a result of this, the intermediate image is generated, 
The corresponding point matching unit 34 makes the 
corresponding areas of the intermediate images coincide. 
The corresponding area is identified by the coordinate of an 
object taken into the intermediate images on the world 

15 coordinate system. 

Fig, 14 shows a procedure for generating a target 
image by the image generating apparatus 100. A designated 
direction is inputted to the input unit 10 (S60) . If any 
target image has been generated before, the update operation 

20 determining unit 26 obtains information about optimal 

original image pair already obtained, from the information 
obtaining unit 18 (362) . If a new optimal original image 
pair is required in order to generate a new target image (Y 
in S64), the image information identifying unit 42 

25 identifies an optimal direction pair for the rendering 

processing (S66) . The image calculating unit 44 performs 
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the rendering processing upon three dimensional data in the 
first storage unit 20 with respect to the optimal direction 
pair (S68), so that the optimal original image pair is 
obtained. If the new optimal original image pair is not 
5 required (N in S64), an optimal original image pair already 
obtained is used. In order to make the direction of sight 
lines of the optimal original image pair coincide with the 
designated direction, the converting unit 32 shifts images 
of the optimal original image pair (S70) to generate 

10 intermediate images. The corresponding point matching unit 
34 makes the corresponding areas of the intermediate images 
coincide (S72) . The combining unit 36 combines the 
coincident intermediate images using a predetermined ratio 
(S7 4) to generate the target image. The generated target 

15 image is outputted from the output unit 38 (S76) and 
displayed on a display window for the monitor 110. 

Figs. 15A through 15H show generation of target image 
from an optimal original image pair by the image generating 
unit 16. Fig. 15A shows a virtual space including buildings 

20 and a tree. In the figure, the intersection of arrows 

indicates a point of view. Angles (pi and cp2 constitute an 
optimal direction pair and an angle cp3 indicates a 
designated direction. Fig. 15B shows an original image 
obtained by a rendering processing in the image calculating 

25 unit 44 with respect to the angle cpl based on three 
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dimensional data. Fig. 15C shows an original image obtained 
by the rendering processing with respect to the angle 92. 

A turning radius is determined as the distance between 
the point of view and the tree. The converting unit 32 
5 shifts the image illustrated in Fig. 15B by the distance 

calculated as a product of the angle <pl - <p3 and the turning 
radius and shifts the image illustrated in Fig. 15C by a 
distance calculated as a product of the angle cpS - cp2 and 
the turning radius, so that intermediate images illustrated 

10 in Figs. 15D and 15E are generated, respectively. Clipping 
is performed upon the intermediate images in the range of 
image to be displayed. As a result, images illustrated in 
Figs. 15F and 15G are obtained. The corresponding point 
matching unit 34 makes the corresponding positions of Figs. 

15 15F and 15G e.g., trees coincide. The combining unit 36 
combines the image illustrated in Fig. 15F with the image 
illustrated in Fig. 15G using a predetermined ratio, so that 
the target image illustrated in Fig. 15H is generated. 

The operation of the image generating apparatus 100 

20 with the above-described structure is as follows. A user of 
a game is traveling at a predetermined movement speed in a 
predetermined direction by the user's instruction. If the 
direction of sight line coincides with the direction of 
travel, a change in the direction of travel by the user 

25 causes the direction of sight line to be changed and a 
designated direction is inputted to the input unit 10 
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accordingly. The image information identifying unit 42 
identifies an optimal direction pair. The image calculating 
unit 4 4 generates an optimal original image pair for the 
optimal direction pair by a rendering processing. The 
5 converting unit 32 shifts the optimal original image pair so 
that the direction of sight line of the optimal original 
image pair coincides with the designated direction^ so as to 
generate intermediate images. The corresponding point 
matching unit 34 causes the corresponding areas of the 

10 intermediate images to overlap at the same position. The 
combining unit 36 combines the intermediate images using a 
predetermined ratio to generate a target image. If a user 
changes the direction of travel again, rendering is not 
necessary when the designated direction is located between 

15 the directions of sight line of optimal original image pair 
already obtained, since a new target image is generated from 
the optimal original image pair already obtained. 

In accordance with this embodiment, a target image 
with any direction of sight line is generated from an 

20 optimal original image pair with discrete directions of 

sight line so that the number of the rendering processes to 
be performed is reduced. An intermediate image which is 
generated from an original image with the direction of sight 
line approximating a designated direction is assigned a 

25 larger weight much, and the corresponding areas of 

intermediate images are made to overlap before combining 
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them to produce the target image. Accordingly, when the 
designated direction is changed, the target image is also 
changed smoothly. 
(Fifth Embodiment) 
5 In accordance with this embodiment, when the range of 

target image on a display window is shifted by an 
instruction from a user and when the size of the range is 
changed, an image generating apparatus of this embodiment 
operates such that an apparent on-screen movement speed in 

10 the designated range (which hereinafter is referred to as 
'^an apparent movement speed") remains an apparent movement 
speed prior to the change in the range. When the range of 
target image is enlarged, an object is relatively moved 
faster in the coordinate system (this movement speed will be 

15 referred to as ^^a movement speed in coordinate system'' 
hereinafter) by maintaining the apparent movement speed. 

Fig. 16 illustrates the structure of an image 
generating apparatus 100 which is of the same type as that 
of Fig. 1 and utilized in this embodiment. The image 

20 generating apparatus 100 has the input unit 10 and an 

updating unit 40. The updating unit 40 includes a speed 
processing unit 50, a coordinate updating unit 52, a display 
update determining unit 54, the image setting unit 12, the 
image obtaining unit 14, the image generating unit 16, the 

25 output unit 38 and the information obtaining unit 18. The 
speed processing unit 50 includes a speed determination 
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parameter obtaining unit 56 and a speed obtaining unit 60, 
This image generating apparatus 100 is different from the 
image generating apparatus 100 illustrated in Fig. 3 in the 
speed processing unit 50, the coordinate updating unit 52 
and the display update determining unit 54 . 

An operation instruction is inputted to the input unit 
10 from a user. The speed determination parameter obtaining 
unit 56 determines a designated scale and the range of 
target image based on the operation instruction from the 
user inputted to the input unit 10. 

A speed storage unit 58 stores numerical values and 
expressions required for relating the size of range of 
target image, an apparent movement speed and a movement 
speed in the coordinate system. It is assumed that a ratio 
of absolute length r of one side of the range of the target 
image in the coordinate system with respect to the movement 
speed V in the coordinate system is the apparent movement 
speed C. a indicates a constant with the dimension of 
distance . 



V 



C 
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A constant relationship is established between the range of 
image to be displayed and the movement speed in the 
coordinate system. 

If a user gives an instruction for faster movement^ 
5 the displayed range is correspondingly widened. Thus, the 
display window is scrolled at a fixed speed irrespective of 
the movement speed in the coordinate system so that the user 
is capable of recognizing a map easily. 

The speed obtaining unit 60 obtains the movement speed 

10 V in the coordinate system in a direction designated by the 
user, based on r and C. 

The coordinate updating unit 52 calculates a movement 
distant per unit time from the movement speed in the 
coordinate system. The unit time is determined as the time 

15 elapsed since a predetermined target image is outputted onto 
the display window until the next target image is outputted 
on the display window. The calculated movement distance is 
added to a coordinate before movement in order to calculate 
a coordinate after movement. The resultant coordinate is 

20 used to update the target image. 

The display update determining unit 54 determines 
whether the range of target image displayed using the 
coordinates after the movement requires an update in the 
current range of target image already displayed. Updating 

25 is usually required when the contents displayed on a screen 
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are scrolled. Updating is not required when an object is 
moved while the background remains unchanged. 

When the designated scale and the range of target 
image are determined as described above, a target image is 
5 generated in accordance with the above-described first to 
fourth embodiments. 

Figs. 17A through 17C show an apparent movement speed 
for various sizes of the range of target image. One of the 
elements for determining the range of target image is an 

10 instruction for altitude of virtual point of view. As the 

altitude of virtual point of view is increased, the range of 
target image is enlarged. Of Figs. 17A through 17C, the 
range of target image in Fig. 17A is the largest and the 
range of target image in Fig. 17C is the smallest. In all 

15 images, movement of an airplane object is indicated by an 
arrow. This arrow indicates movement on a screen per unit 
time. In spite of various ranges of target image, images 
are generated such that an apparent movement speed for the 
airplane remains constant. In these figures, the object is 

20 moving in the range of stationary target image. 

Alternatively, the object may be stationary and the range of 
target image may be shifted. 

Fig. 18 shows a procedure for generating a target by 
the image generating apparatus 100 when an instruction for 

25 movement is given. The target image has already been 
displayed on a display window and a user gives an 
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instruction to change the range of the target image. An 
operation instruction from a user is inputted to the input 
unit 10 illustrated in Fig. 16 (S130) . On the basis of the 
size of range of the target image determined by a designated 
5 scale or the like, the speed determination parameter 

obtaining unit 56, the speed storage unit 58 and the speed 
obtaining unit 60 obtain a movement speed in the coordinate 
system (S132) and calculate the designated scale. The 
coordinate updating unit 52 calculates a movement distance 

10 in the coordinate system per unit time from the movement 
speed in the coordinate system (S134). 

The movement distance in the coordinate system is 
added to the coordinate before the movement in order to 
update the coordinate (S136) . The range of target image is 

15 calculated from the updated coordinate and the designated 

coordinate. If the currently displayed range of target image 
must be updated (Y in S138), the image setting unit 12, the 
image obtaining unit 14 and the image generating unit 16 
generate a new target image (S140) . The generated target 

20 image is outputted from the output unit 38 (S142) and 
displayed on the display window on the monitor llO. 

The operation of the image generating apparatus 100 
with the above-described structure is as follows. While a 
user of a game moves in the sky above Tokyo ^ a wide range of 

25 23 Wards in Tokyo is displayed- Since an original image 
with a lower detail level and assigned a larger weight is 
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blended with an original image with a higher detail level, a 
group of skyscrapers are displayed with relatively darker 
shades and the individual buildings included in the group 
are displayed with relatively lighter shades. When the user 
5 decreases an altitude and a movement speed near the group of 
skyscrapers, in accordance with such operation, the range of 
Tokyo displayed becomes narrower until the view is 
restricted to Shinjuku Ward, for example. The individual 
buildings displayed with lighter shades are gradually 

10 displayed more clearly. Nevertheless, at the same time, the 
buildings are still displayed as the group. Thus, even if 
the contents of display are changed in accordance with a 
change in the movement speed, user' s operability does not 
suffer. In accordance with such an operation, when a user 

15 is moving at a high speed, buildings are not displayed 

individually and thus excess information is provided from 
being provided to the user. If the user is interested in a 
part of the displayed information, appropriate information 
is supplied to the user when the speed is decreased. In a 

20 user's operation for movement, the speed at which displayed 
images are scrolled is fixed. Thus, the user is capable of 
viewing information uniformly regardless of the movement 
speed. 

In accordance with this embodiment, image generation 
25 is performed such that, even if the size of range of target 
image is changed, an apparent on-screen movement speed in 
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the range of target image remains an apparent movement speed 
before the change- As a result, a user can continue to move 
without unpleasant feelings. As a user gets closer to a 
destination, a movement speed in the coordinate system is 
5 decreased, so that the user is capable of reaching the 
precise destination . 
(Sixth Embodiment ) 

In accordance with this embodiment, as in the fifth 
embodiment, an instruction about movement and a designated 

10 scale is inputted from a user and the range of target image 
is shifted as the user travels in a scene. Further, 
according to this embodiment, in addition to input of 
designated scale from a user, conditions for automatically 
changing the size of range of target image are set. If such 

15 conditions are satisfied, the range of target image is 
forcibly shifted in accordance with the conditions. 

Fig, 19 shows the structure of an image generating 
apparatus 100 which is of the same type as that illustrated 
in Fig.-l and utilized in this embodiment. The image 

20 generating apparatus 100 has the input unit 10 and the 

updating unit 40. The updating unit 40 includes the speed 
processing unit 50, the coordinate updating unit 52, the 
display update determining unit 54, the image setting unit 
12, the image obtaining unit 14, the image generating unit 

25 16, the output unit 38 and the information obtaining unit 18. 
The speed processing unit 50 includes the speed 
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determination parameter obtaining unit 56 and the speed 
obtaining unit 60. This image generating apparatus 100 is 
different from the image generating apparatus 100 
illustrated in Fig. 3 in the speed processing unit 50, the 
5 speed storage unit 58, the coordinate updating unit 52 and 
the display update determining unit 54, and is different 
from the image generating apparatus 100 illustrated in Fig. 
16 in the operation of the speed determination parameter 
obtaining unit 56. 

10 The speed determination parameter obtaining unit 56 

generates an instruction for forcibly changing the size of 
range of target image in addition to a designated scale 
based on an operation instruction from a user. This 
instruction may be generated on the basis of processing in 

15 the speed determination parameter obtaining unit 56 or may 
be generated in accordance with an instruction about a 
movement direction inputted from a user. 

In the former case, an area where the range of target image 
should be automatically changed is set in advance in an 
20 image. Then, when a user enters this area, the size of 

range of target image is changed. In the latter case, when 
successive directions of movement inputted from the input 
unit 10 coincide, the size of range of target image is 
increased. 

25 The image setting unit 12, the image obtaining unit 14, 

the image generating unit 16, the output unit 38 and the 
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information obtaining unit 18 generate a target image in the 
same manner as in the first to fourth embodiments. 

Fig. 20 shows a data file in which an area where the 
size of range of target image is forcibly decreased and an 
5 area where the size of range of target image is forcibly 

increased are set (these areas will be generically referred 
to as ^^operation areas'' hereinafter) . When an object enters 
the operation area, the entry is detected on the basis of 
coordinates by the speed determination parameter obtaining 

10 unit 56 so that the size of range of target image is changed. 
In this embodiment, the operation area is set in advance 
depending on the presence or absence of object a user should 
pay attention to. This file is stored in the speed storage 
unit 58. As in Fig. 5, an operation area with a 

15 predetermined scale is specified by a data start point and a 
data end point. 

The item ^'ID" within the file indicates an instruction 
for changing the size of range of target image. The 
character "'U'' indicates an instruction for enlarging the 

20 range of target image and the character ^'D" indicates an 
instruction for reducing the range of target image. For 
example, an area which does not include an object a user 
should pay attention to may be determined as ^^the area where 
the range of target image is enlarged", i.e., an enlarged 

25 area. In this case, the user can pass the corresponding area 
at a high speed. An area which includes an object a user 
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should pay attention to or a specific point in data 
processing may be determined as ''the area where the range of 
target image is reduced"^ i.e., a reduced area. In this 
case, the user is capable of moving in the area slowly and 
5 easily recognizing the presence of the area. 

Fig. 21 shows changes in the size of range of target 
image when the user passes through the operation area. In 
an initial state, the size of range of target image is 
determined by a user-designated value, i.e., a designated 

10 scale. When the user enters a reduced area at PI, the range 
of target image is reduced by the speed determination 
parameter obtaining unit 56 and the movement speed in the 
coordinate system is decreased without the user performing 
an operation for decreasing the speed. Thus, the user is 

15 capable of understanding the contents in the range of target 
image in detail. When the user remains in the reduced area, 
the range of target image continues to be gradually reduced 
so that detailed information is displayed even more clearly. 
Referring to Fig. 21, at P2, the user is in the minimum 

20 range of target image set in advance. Between P2 to P3, at 
which the user exits the reduced area, the system awaits a 
user's instruction to return to the original range. When 
the user exits the reduced area at P3, the size of range at 
P4 is determined by the operation instruction from the user. 

25 When the user enters the enlarged area at P5, the size of 

range at P6 becomes maximum determined in view of visibility 
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as described above. Thus, the speed at which the user moves 
in the coordinate system is increased so that the user is 
capable of traveling swiftly in the area which does not 
include objects the user should pay attention to. When the 
5 user exits the enlarged area at P7, the range of target 
image returns to a size determined by the user-designated 
value again at P8 . 

As described above, in accordance with this embodiment, 
whether the range of target image should be enlarged or 

10 reduced is determined depending on coordinates so that the 
range of target image is changed accordingly, regardless of 
the operation instruction from a user. As a result, it is 
ensured that the user is capable of recognizing information 
that must be recognized. 

15 The operation of the image generating apparatus 100 

with the above-described structure is as follows. While a 
user of a game is moving as a pedestrian like walking in a 
street, for example, the user may enter an enlarged area, 
e.g. a desert. The speed obtaining unit 60 then obtains a 

20 higher movement speed in the coordinate system. The 

coordinate updating unit 52 calculates a movement distance 
in the . coordinate system from the movement speed in the 
coordinate system, adds this movement distance to the 
original coordinate to update the coordinate. On the basis 

25 of the updated coordinate, the image setting unit 12, the 
image obtaining unit 14 and the image generating unit 16 
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update the target image, resulting in an image with an 
elevated point of view above the desert instead of a point 
of view of a user walking in the desert. As a result, the 
user is capable of swiftly passing through the desert that 
5 the user is not interested in. 

A variation of the sixth embodiment will be described. 
Fig. 22 illustrates a procedure for changing, when the range 
of target image is shifted successively in the same 
direction, the size of range of target image in accordance 

10 with the degree of succession, in the speed determination 
parameter obtaining unit 56. A movement instruction is 
inputted to the input unit 10 illustrated in Fig. 19 in 
response to the user's operation (S180). If this movement 
instruction is inputted in a state in which the range of 

15 target image remains stationary, it is determined that a 

movement is started (Y in S182) and the speed determination 
parameter obtaining unit 56 resets a counter included 
therein (S184). If a direction of movement according to the 
instruction is the same as that of the instruction inputted 

20 the last time (Y in S186) , a count is incremented (S188). 
Further, for example, on the basis of a predetermined rule 
which states that, when a count reaches 10, the range of 
target image is made twice as large, the speed determination 
parameter obtaining unit 56 outputs an instruction for 

25 changing the size of range of target image. The image 

setting unit 12, the image obtaining unit 14 and the image 
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generating unit 16 change the size of range of target image 
accordingly (S190) . If the direction of movement according 
to the instruction is different from that of the movement 
instruction inputted the last time (N in S186) , the counter 
5 is reset (S192) . Then, the size of range of target image is 
returned to an initially set value or the size calculated 
from the designated scale provided by the user (S194) . The 
speed obtaining unit 60 obtains the movement speed in the 
coordinate system on the basis of the range of target image 
10 (S196) . The subsequent operations are the same as those in 
Fig. 18. 

In accordance with the variation described above, when 
a user continues to input instructions for movement in a 
fixed direction, the movement speed in the coordinate system 

15 is correspondingly changed. Thus, in spite of a simple 

interface, the movement speed in the coordinate system is 
changed properly. Generally, when a user continues to give 
instructions for movement in a fixed direction, it is 
assumed that the user desires faster movement. Thus, an 

20 object of operation by the user is properly satisfied 
according to the variation. 

The present invention has been described using the 
various embodiments. A person skilled in the art would 
understand that these embodiments are merely illustrations, 

25 modified example are possible by combinations of components 
and processes thereof and such modified examples fall within 
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the scope of the present invention. The modified examples 
will be described below. 

Although the first through sixth embodiments assume 
map image applications and games, applications of the 
5 embodiments are not restricted to them. For example, the 
embodiments may be applied to car navigation. In the case 
of car navigation, a scale of a map is changed in accordance 
with a speed of vehicle and yet a point of interest such as 
a building is properly recognized before and after a change 

10 in speed. Thus, it is possible to prevent the user from 
losing sight of a target. As such, the present invention 
finds wide applications for display of a predetermined space 
or object on a display unit. 

In the first through sixth embodiments, two original 

15 images are identified in order to generate a target image. 
The obtaining identifying unit 28 needs not to identify two 
original images - Three or more original images may be 
identified. When three or more original images are 
identified, the combining unit 36 desirably sets a ratio of 

20 combining intermediate images generated from the original 
images, in accordance with a plurality of intermediate 
images. For example, as in the first embodiment, a 
relatively large weight is assigned to an intermediate image 
corresponding to an original image with a scale 

25 approximating a designated scale. According to this 

modified example, a target image which reflects the contents 
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of a lot of original images is generated. That is, an image 
in a range to be displayed is generated smoothly in 
accordance with changes in predetermined parameters related 
to the image. 

5 In the first through sixth embodiments, the image 

obtaining unit 14 selects an optimal original image pair 
corresponding to the entire range of target image in order 
to generate the target image. The optimal original image 
pair needs not to be selected so as to correspond to the 

10 entire range of target image. For example, different 

optimal original image pairs may be selected for different 
sets of coordinates within the range of target image. Pixel 
values displayed for the coordinates may be obtained by 
combining corresponding pixel values in the optimal original 

15 image pair. In accordance with this modified example, only 
a part of the range of target image may be displayed in 
greater detail as compared to other parts. 

In the first through sixth embodiments, the combining 
unit 36 combines two intermediate images using one 

20 predetermined ratio. Alternatively, a plurality of ratios 
may be provided. For example, different ratios may be used 
for reducing the size of range of target image and for 
enlarging the same. In the former case, combination is 
performed such that a relatively large weight is assigned to 

25 an intermediate image generated from an original image with 
a smaller scale. In the latter case, combination is 
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performed such that the aforementioned weight is smaller. 
According to this modified example, contents displayed 
before the size of range of target image is changed affect 
the target image to a relatively larger degree. Accordingly, 
5 unpleasant feelings felt by the user for changes in the size 
of range of target image are alleviated. 

According to the fifth and sixth embodiments, the 
movement speed in the coordinate system depends on the size 
of range of target image. If the size of range of target 

10 image is determined, the movement speed in the coordinate 
system is also uniquely determined. However, one-to-one 
correspondence need not be established between the size of 
range of target image and the movement speed in the 
coordinate system, in the speed processing unit 50. For 

15 example, in order to visualize the effect of inertia in a 
case in which a stationary state is changed to an active 
state or vice versa, the movement speed in the coordinates 
system may be gradually increased or decreased, respectively, 
even if the size of range of target image remain fixed. The 

20 speed processing unit 50 may delay a change in the size of 

range of target image when a change in the movement speed in 
the coordinate system occurs. According to this modified 
example, the user's unpleasant feelings are further 
alleviated for changes in the size of range of target image 

25 in accordance with changes in the movement speed. 
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An operation area is stored in advance as a data file 
in the sixth embodiment. In the speed determination 
parameter obtaining unit 56, the operation area needs not to 
remain registered in the data file and areas may be deleted 
or added. For example, in a game, an area with a high 
density of objects that a user should pay attention to may 
first be as an enlarged area in the range of target image. 
When the density becomes lower in accordance with a progress 
of the game, this area may be deleted from registration. 
According to this modified example, flexible processing in a 
game in accordance with its scenario is enabled. That is, 
the data file may be appropriately modified. 

Although the present invention has been described by 
way of exemplary embodiments, it should be understood that 
many changes and substitutions may further be made by those 
skilled in the art without departing from the scope of the 
present invention which is defined by the appended claims , 
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